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Intro 



Language Composition 


"The ability to write a computer program in a 
mix of programming languages." 
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Why Compose Languages? 


® Parts of a program are expressed best with different languages. 


9 Access to a broader set of libraries. 


9 Language migration. 
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Most languages have a Foreign Function Interface 


Filel (Lang A) File2 (Lang B) 
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Most languages have a Foreign Function Interface 


Filel (Lang A) File2 (Lang B) 

FFI call 


Co^ se 




Limited choice oflangs 

(second langis nearly always Q 


Software Development Team 


5/61 


http://soft-dev.org/ 




Can we do better? 


9 Mix languages in the same file 
9 Mix {methods, functions, expressions} 
9 Integrate scoping 
9 Arbitrary languages 

9 . . . 
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Approach 



Breaking 


PL X 


PLY 
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Breaking it Down 



syntax 

PLZ 

runtime 
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Composing Syntax 


PL X 1 


PLY 1 


PLZ ^ 

<grammar> 


<grammar> 


<grammar> 

expr : : = ... 

U 

expr : : = ... 


expr : : = ... 

term: : = ... 

I ■■■ 

term: : = ... 

i ••• 


term: : = ... 

I ■■■ 

[ ••• 

func : : = ... 


i ... 

func : : = ... 


I ■■■ 

func : : = ... 


Easy? 
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Composing Syntax 


® LR — > Possibly undefined. 
® PEG -> Shadows. 


o GLR Ambiguous. 
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Syntax Directed Editing 


public class Say extends <none> implements <none> { 

private String textchanged; 

«properties» 

«initializer» 
public Say (String 
Q |<no statements> 
a > 

«nethods» 

«nested classifiers» 

£ } 


text) { 
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Composing Runtimes 



Easy? 
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Runtime composition 
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Runtime composition 
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Runtime composition 
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Runtime composition 
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Runtime composition 
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Our Approach 


Summary: 

We need a practical way of composing syntax and runtimes. 
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Our Approach 


Summary: 

We need a practical way of composing syntax and runtimes. 

I 

Language Boxes + Meta-tracing 
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Language Boxes 


® Borrows ideas from SDE. 


® Palatable editing experience. 


9 Simple and practical way to compose grammars. 
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Language Boxes: E.g. Java + SQL 


Begin writing Java code 

I 

for (string s : 
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Language Boxes: E.g, Java + SQL 


for (string s 



Open SQL language box 
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Language Boxes: E.gjava + SQL 


Write SQL code 


for (string s : SELECT * FROM tbl WHERE 
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Language Boxes: E.g, Java + SQL 


for (string s : 

SELECT * FROM tbl WHERE 

name = this 

. name ; ) { 


Java code 
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Meta-tracing 
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Interpreters are Loops 


9 Tell a meta-tracer about the interpreter loop. 


o Generate a tracing JIT. 


9 Trace the interpreter itself, not the user program. 
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Adding a JUT with Meta-tracing 


pc : = 0 
while 1 : 

instr := load_next_instruction (pc) 
if instr == POP: 
stack . pop ( ) 
pc += 1 

elif instr == BRANCH: 

off = load_branch_ jump (pc) 
pc += off 
elif . . . : 
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Adding a JUT with Meta-tracing 


pc : = 0 
while 1 : 

jit_merge_point (pc) 

instr := load_next_instruction (pc) 
if instr == POP: 
stack . pop ( ) 
pc += 1 

elif instr == BRANCH: 

off = load_branch_ jump (pc) 
pc += off 
elif . . . : 
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Meta-tracingJITs 


FL Interpreter 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack. push (True) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 

elif instr == INSTR_IF: 
result = stack.popO 
if result == True: 
program_counter += 1 
else : 

program_counter += 

read_jump_if_instruction ( ) 
elif instr == INSTR_ADD : 
lhs = stack.popO 
rhs = stack.popO 
if isinstance (lhs, int) 
and isinstance (rhs, int): 
stack .push (lhs + rhs) 
else : ... 

program_counter += 1 
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Meta-tracingJITs 


FL Interpreter 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack . push ( True ) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 
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Meta-tracingJITs 


FL Interpreter 

User program (lang FL) 

program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack. push (True) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 

assume x == 6 
if x < 0: 
x = x + 1 
else : 

x = x + 2 
x = x + 3 
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Meta-tracingJITs 


FL Interpreter Initial trace 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, 
if lhs < rhs: 

stack . push ( True ) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 


vO = <program_counter> 
vl = <stack> 
v2 - <vars> 

v3 = load_instruction (vO) 
guard_eq(v3, INSTR_VAR_GET) 
v4 = dict_get(v2, "x") 
list_append (vl, v4) 
v5 = add(v0, 1) 
v6 = load_instruction (v5) 
guard_eq(v6, INSTR_INT) 
list_append(vl, 0) 
v7 = add (v5, 1) 
v8 = load_instruction (v7) 
guard_eq ( v8 , INSTR_LESS_THAN ) 
v9 = list_pop (vl ) 
vlO = list_pop(vl) 
guard_type (v9, int) 
guard_type (vlO, int) 
guard_not_less_than (v9, vlO) 
int) : list_append (vl. False) 

vl 1 = add (v7, 1) 
vl2 = load_instruction (vll) 
guard_eq (vl2, INSTR_IF) 
vl3 = list_pop(vl) 
guard_false (vl3) 


Software Development Team 


20/61 


http://soft-dev.org/ 




Meta-tracingJITs 


Initial trace in full 


vO = <program_counter> 
vl = <stack> 
v2 = <vars> 

v3 = load_instruction (vO) 

guard_eq ( v3 , INS TR_VAR_GE T ) 

v4 = dict_get(v2, "x") 

list_append (vl, v4) 

v5 = add(vO, 1) 

v6 = load_instruction (v5) 

guard_eq (v6, INSTR_INT) 

list_append (vl, 0) 

v7 = add(v5, 1) 

v8 = load_instruction (v7) 

guard_eq(v8, I N S TR_LE S S_THAN ) 

v9 = list_pop (vl) 

vlO = list_pop(vl) 

guard_type (v9, int) 

guard_type (vlO, int) 

guard_not_less_than (v9, vlO) 

list_append (vl. False) 

vll = add(v7, 1) 

vl2 = load_instruction (vll) 

guard_eq (vl2, INSTR_IF) 

vl3 = list_pop(vl) 

guard_false (vl3) 

vl4 = add (vll, 2) 


vl5 = load_instruction (vl4) 

guard_eq (vl5, INSTR_VAR_GET) 

vl6 = dict_get (v2, "x") 

list_append (vl, vl6) 

vl7 = add (vl4, 1) 

vl8 = load_instruction (vl7) 

guard_eq (vl8, INSTR_INT) 

list_append (vl, 2) 

vl9 = add (vl7, 1) 

v20 = load_instruction (vl9) 

guard_eq(v20, INSTR_ADD) 

v21 = list_pop(vl) 

v22 = list_pop(vl) 

guard_type (v21, int) 

guard_type (v22, int) 

v23 = add(v22, v21) 

list_append (vl, v23) 

v24 = add (vl9, 1) 

v25 = load_instruction (v24) 

guard_eq (v25, INSTR_VAR_SET) 

v26 = list_pop(vl) 

dict_set(v2, "x", v26) 

v27 = add(v24, 1) 

v28 = load_instruction (v27) 

guard_eq (v28, INSTR_VAR_GET ) 

v29 = dict_get(v2, "x") 


list_append (vl, v29) 

v30 = add (v27, 1) 

v31 = load_instruction (v30) 

guard_eq(v31, INSTR_INT) 

list_append (vl, 3) 

v32 = add(v30, 1) 

v33 = load_instruction (v32) 

guard_eq (v33, INSTR_ADD) 

v34 = list_pop(vl) 

v35 = list_pop(vl) 

guard_type (v34, int) 

guard_type (v35, int) 

v36 = add (v35, v34) 

list_append (vl, v36) 

v37 = add (v32, 1) 

v38 = load_instruction (v37) 

guard_eq(v38, INSTR_VAR_SET ) 

v39 = list_pop(vl) 

dict_set(v2, "x", v39) 

v40 = add (v37 , 1) 
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Optimisation 


Optimised Trace 

vl = <stack> 
v 2 = <vars> 
v4 = dict_get (v2, "x") 

guard_type (v4 , int) 
guard_not_less_than (v4 , 0) 

v23 = add(v4, 5) 
dict_set(v2, "x", v23) 
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How Does this Apply to VM Composition? 



fPL Z 


Interpreter 
Tracing JIT 
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How Does this Apply to VM Composition? 



fPL Z 


Interpreter 
Tracing JIT 
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Putting it All Together 



jtli 


Composed 

Program 


Intermediate 
(x-lang interfaces) 


Composed 

VM 
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Summarising our Approach 


o Editing with Language boxes. 

a Practical syntactic composition, 
a Traditional "code editor" look and feel. 


9 Interpreter Composition with Meta-tracing 
a Relatively little engineering effort, 
a Language agnostic JIT optimisations. 

9 Glue together editor and VM with intermediate representation. 
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Our Compositions 



Our Language Compositions 


® Unipycation: Python + Prolog 
® PyHyp: PHP + Python 
9 SQPyte: Python + SQLite 
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Our Language Compositions 


a Unipycation: Python + Prolog 
« PyHyp: PHP + Python 
a SQPyte: Python + SQLite 
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Unipycation 

Python + Prolog 


/ 

y 

Pyrolog 

J 

' 

k 1 

1 ' 

k 

i 
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Unipycation 


® Fairly coarse "proof of concept" composition. 


o Shows that we can glue together meta-tracing interpreters. 


o Idiomatic interoperability between Python and Prolog. 
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Unipycation Example 


from uni import Engine 
engine = Engine (""" 

edge (a, c) . edge(c, b) . edge(c, d) . edge(d, e) . 
edge (b, e) . edge(c, f) . edge(f, g) . edge(e, g) . 
edge (g, b) . 

path (From, To, MaxLen, Nodes) 

path (From, To, MaxLen, Nodes, 1) . 

II II II ^ 

paths = engine . db . path . iter 

for (to, nodes) in paths ("b", None, 4, None) : 
print ("To %s via %s" % (to, nodes)) 
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Outcomes of Unipycation 


9 Proved the concept 

a We wrote some fairly complex composed programs. 


9 Relatively little engineering effort. 


9 Gave fairly good performance. 

® Cross-language tracing works. 
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Unipycation Performance 


s 


Variant 1 
Lang X 
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Unipycation Performance 



Variant 2 
Lang Y 


Variant 4 
Lang Y + Lang X 
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Unipycation Performance 


Benchmark 

Pythons 

Pyth 

Prolog 

on 

Python^Prolog 

Prolog 

Python-^Prolog 

Unipycation 

SmallFunc 

1.276x 

±0.081 

0.201 x 

±0.038 

1 .000 x 

L1A0R 

1.005x 

±0.053 

0.957 x 

±0.057 

I.OOOx 

LI AIR 

1.072x 

±0.071 

1.034x 

±0.069 

I.OOOx 

NdLIAIR 

5.902x 

±0.044 

5.635x 

±0.216 

I.OOOx 

TCons 

6.073 x 

±0.106 

13.471 x 

±0.208 

I.OOOx 

Lists 

5.969x 

±0.025 

3.335x 

±0.010 

I.OOOx 


Benchmark 

Python~>Pro!og 

Prolog 

Python-^Prolog 

Unipycation 

sat-modeis 

1 .462 x 

±0.021 

I.OOOx 

tube 

1.014x 

±0.019 

I.OOOx 

connect4 

1.431 x 

±0.014 

I.OOOx 
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Unipycation Limitations 


9 Little syntactic integration. 

a Eco served little more than a syntax checker. 


9 Rudimentary type conversions. 

® Python objects opaque to Prolog. 
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PyHyp 


PHP + Python 
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Goals of PyHyp 


How far can we push language composition? 


9 Syntactic interoperability harnessing Eco. 


9 Less opaque type conversions. 


9 Performance <2-3x over mono-language programs. 
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Features of PyHyp 


® Calling Python functions and methods from PHP 
9 Calling PHP functions and methods from Python 
9 Transparent type conversions 
9 Arbitrary nesting of foreign functions 
9 Python expressions in PHP 
9 "Embedding" Python methods inside PHP classes 
9 Adds support for references to Python 
9 Cross-language scoping 
9 Cross-language exceptions 
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PyHyp Demo 
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PyHyp Performance 



Benchmark 

HippyVM 

PyHyppHP 

PyHyppy 

PyPy 

instchain 

0.912 

±0.0011 

1.000 


0.675 

±0.0007 

llaOr 

1.368 

1.000 

1.360 

1.340 

±0.0004 


±0.0003 

±0.0106 

Hair 

1.306 

1.000 

1.303 

1.140 

±0.0017 


±0.0016 

±0.0022 

lists 

0.975 

1.000 

0.560 

0.497 

±0.0020 


±0.0012 

±0.0010 

ref_swap 

1.000 

±0.0002 

1.000 

0.700 

±0.0001 


return_simple 

1.000 

±0.0001 

1.000 

0.778 

±0.0001 

0.889 

±0.0001 

scopes 

4.511 

±0.0025 

1.000 

0.929 

±0.0005 

1.000 

±0.0001 

smallfunc 

1.000 

±0.0001 

1.000 

0.750 

±0.0000 

1.000 

±0.0001 

sum 

0.999 

1.000 

0.750 

0.874 

±0.0001 


±0.0001 

±0.0001 

sum_meth 

0.999 

±0.0001 

1.000 


0.874 

±0.0002 

sum_meth_attr 

0.999 

±0.0061 

1.000 


0.904 

±0.0057 
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PyHyp Performance (contd.) 


Benchmark 

HippyVM 

PyHyppHP 

PyHyppy 

PyPy 

totaljist 

0.864 

±0.0002 

1.000 

1.508 

±0.0004 

0.587 

±0.0003 

walkjist 

0.779 

±0.0011 

1.000 

1.601 

±0.0026 

1.080 

±0.0015 

deltablue 

4.325 

±0.0212 

1.000 


0.457 

±0.0026 

fannkuch 

1.848 

±0.0007 

1.000 

1.891 

±0.0005 

1.005 

±0.0004 

mandel 

0.921 

±0.0005 

1.000 

0.999 

±0.0003 


richards 

0.853 

±0.0010 

1.000 


0.488 

±0.0005 

Geometric Mean 

1.222 

±0.0006 

1.000 

0.963 

±0.0003 

0.813 

±0.0007 


Worst case: 2.6x overhead 
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Semantic Friction 



Semantic Friction 


Implementing desired behaviour: relatively easy 
Deciding the correct behaviours: hard 
"Semantic friction" 

Compromises sometimes must be made. 
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Semantic Friction: References 


function swap(&$a, &$b) { 

$temp = $a; 

$a = $b; 

$b = $temp; 

} 


$ x — 1 ; $y = 2; 
swap($x, $y) ; 
echo "$x $y"; 


Pure PHP - Prints "2 1 " 
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Semantic Friction: References 


@php_decor (ref s= (0, 1)) 
def swap (a, b) : 

temp = a . deref ( ) 

a . store (b . deref ( ) ) 

b . store (temp) 


$ x — 1 ; $y = 2; 
swap($x, $y) ; 
echo "$x $y"; 


Callee in Python 
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Semantic Friction: References 


function swap(&$a, &$b) { 

$temp = $a; 

$a = $b; 

$b = $temp; 

} 


x = PHPRef ( 1 ) ; y = PHPRef(2) 
swap (x, y) ; 

print ("%s %s" % (x.deref () , y.deref())) 


Caller in Python 
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Semantic Friction: Array/Dict/List Conversions 


PHP Language Threshold >- Python 


( \ 
A n+- 


r \ 

■Inf 

lire 

^ -> 


i nt 


str 

v > 



' \ 

str 





obj 

v / 



obj 
/- > 




obj 

0> 

"adapted 
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Semantic Friction: Array/Dict/List Conversions 



PHP 

Python 

Sequence type 

array 

list 

Mapping type 

array 

diet 
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Semantic Friction: 


php > $a = ["this", "is", 
php > print_r($a); 

Array 

( 

[0] => this 

[1] => is 

[2] => a 

[3] => list 

) 
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Semantic Friction: Array/Dict/List Conversions 


PHP 


Language Threshold 


array 

\ 

r 

(listj 


V 

integer keys 



array 
. [diet] 


r 



mixed keys 



list 


diet 


Python 
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Semantic Friction: Array/Dict/List Conversions 


PHP Language Threshold >- 


(array) 


list 






diet 


Python 
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Semantic Friction: Array/Dict/List Conversions 


PHP -<■ Language Threshold >- Python 





array) 

>- 

list 

int keys 


(array) 

(array) 



diet 

mixed keys 


(array) 
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Semantic Friction: Array/Dict/List Conversions 


PHP -<■ Language Threshold >- Python 


' \ 

list 

(array) 

int keys 



$a[ "x" ] = 4 

Y 

'array 

mixed keys 
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Semantic Friction: Array/Dict/List Conversions 


PHP -< Language Threshold >- Python 






A 


list 

(array) 



int keys 



$a[ "x" ] = 4 

< 



'array) 

Inconsistent list! 

mixed keys 
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Semantic Friction: Array/Dict/List Conversions 


PHP 


Language Threshold 


Python 


list 

(array' 


as list ( ) 


(array 


diet 
( array) 
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Semantic Friction: Cross Language Scoping 


1 

2 

3 

4 

5 

6 
7 
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|$ range = 10; 

del f () : 

print( range) 

f 0 ; 






Semantic Friction: Cross Language Scoping 


1 

2 

3 

4 

5 

6 
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|$range = 10; 

del f () : 

print( range) 


Should print: 10 
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Semantic Friction: Cross Language Scoping 
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f ( ) : 

print( range) 






Semantic Friction: Cross Language Scoping 


f 0 : 

print( range) 


Should print: <built-in function range> 
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Semantic Friction: Cross Language Scoping 


If a variable is not bound it the current box: 


O Search boxes outwards starting with the parent box. 

Q Look in the "global" namespace of the current language. 
Q Look in the "global" namespace of the other language. 


"Globa Is" 
o Python: {builtins} 
o PHP: {functions, classes} 
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Conclusions 



Conclusions 


o Language boxes: 

a Practical syntax composition, 
a Decent editor experience. 

9 Meta-tracing: 

a Compositions with relatively little effort, 
a Good performance. 


9 Implementing x-lang behaviours is easy. 

9 Designing x-lang behaviours is hard, 
a Semantic friction. 
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Future Work 


® Tools for composed programs 
a Debugging 
a Profiling 
a Version control 

a . . . 


o Statically typed/functional languages. 


a Compositions with >2 languages involved. 
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Thanks 



Language Boxes + Meta-tracing 
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Meta-tracingJITs 


FL Interpreter 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack. push (True) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 

elif instr == INSTR_IF: 
result = stack.popO 
if result == True: 
program_counter += 1 
else : 

program_counter += 

read_jump_if_instruction ( ) 
elif instr == INSTR_ADD : 
lhs = stack.popO 
rhs = stack.popO 
if isinstance (lhs, int) 
and isinstance (rhs, int): 
stack .push (lhs + rhs) 
else : ... 

program_counter += 1 
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Meta-tracingJITs 


FL Interpreter 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack . push ( True ) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 
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Meta-tracingJITs 


FL Interpreter 

User program (lang FL) 

program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, int) : 
if lhs < rhs: 

stack. push (True) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 

assume x == 6 
if x < 0: 
x = x + 1 
else : 

x = x + 2 
x = x + 3 
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Meta-tracingJITs 


FL Interpreter Initial trace 


program_counter = 0; stack = [] 
vars = { . . . } 
while True: 

jit_merge_point (program_counter) 
instr = load_inst ruction <program_counter) 
if instr == INSTR_VAR_GET : 
stack. push ( 

vars [read_var_name_f rom_instruction () ] ) 
program_counter += 1 
elif instr == INSTR_VAR_SET : 

vars [read_var_name_f rom_instruction () ] 

= stack.popO 
program_counter += 1 
elif instr == INSTR_INT: 

stack. push (read_int_f rom_instruction () ) 
program_counter += 1 
elif instr == INSTR_LESS_THAN : 
rhs = stack.popO 
lhs = stack.popO 

if isinstance (lhs, int) and isinstance (rhs, 
if lhs < rhs: 

stack . push ( True ) 
else : 

stack. push (False) 
else: . . . 

program_counter += 1 


vO = <program_counter> 
vl = <stack> 
v2 - <vars> 

v3 = load_instruction (vO) 
guard_eq(v3, INSTR_VAR_GET) 
v4 = dict_get(v2, "x") 
list_append (vl, v4) 
v5 = add(v0, 1) 
v6 = load_instruction (v5) 
guard_eq(v6, INSTR_INT) 
list_append(vl, 0) 
v7 = add (v5, 1) 
v8 = load_instruction (v7) 
guard_eq ( v8 , INSTR_LESS_THAN ) 
v9 = list_pop (vl ) 
vlO = list_pop(vl) 
guard_type (v9, int) 
guard_type (vlO, int) 
guard_not_less_than (v9, vlO) 
int) : list_append (vl. False) 

vl 1 = add (v7, 1) 
vl2 = load_instruction (vll) 
guard_eq (vl2, INSTR_IF) 
vl3 = list_pop(vl) 
guard_false (vl3) 
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Meta-tracingJITs 


Initial trace in full 


vO = <program_counter> 
vl = <stack> 
v2 = <vars> 

v3 = load_instruction (vO) 

guard_eq ( v3 , INS TR_VAR_GE T ) 

v4 = dict_get(v2, "x") 

list_append (vl, v4) 

v5 = add(vO, 1) 

v6 = load_instruction (v5) 

guard_eq (v6, INSTR_INT) 

list_append (vl, 0) 

v7 = add(v5, 1) 

v8 = load_instruction (v7) 

guard_eq(v8, I N S TR_LE S S_THAN ) 

v9 = list_pop (vl) 

vlO = list_pop(vl) 

guard_type (v9, int) 

guard_type (vlO, int) 

guard_not_less_than (v9, vlO) 

list_append (vl. False) 

vll = add(v7, 1) 

vl2 = load_instruction (vll) 

guard_eq (vl2, INSTR_IF) 

vl3 = list_pop(vl) 

guard_false (vl3) 

vl4 = add (vll, 2) 


vl5 = load_instruction (vl4) 

guard_eq (vl5, INSTR_VAR_GET) 

vl6 = dict_get (v2, "x") 

list_append (vl, vl6) 

vl7 = add (vl4, 1) 

vl8 = load_instruction (vl7) 

guard_eq (vl8, INSTR_INT) 

list_append (vl, 2) 

vl9 = add (vl7, 1) 

v20 = load_instruction (vl9) 

guard_eq(v20, INSTR_ADD) 

v21 = list_pop(vl) 

v22 = list_pop(vl) 

guard_type (v21, int) 

guard_type (v22, int) 

v23 = add(v22, v21) 

list_append (vl, v23) 

v24 = add (vl9, 1) 

v25 = load_instruction (v24) 

guard_eq (v25, INSTR_VAR_SET) 

v26 = list_pop(vl) 

dict_set(v2, "x", v26) 

v27 = add(v24, 1) 

v28 = load_instruction (v27) 

guard_eq (v28, INSTR_VAR_GET ) 

v29 = dict_get(v2, "x") 


list_append (vl, v29) 

v30 = add (v27, 1) 

v31 = load_instruction (v30) 

guard_eq(v31, INSTR_INT) 

list_append (vl, 3) 

v32 = add(v30, 1) 

v33 = load_instruction (v32) 

guard_eq (v33, INSTR_ADD) 

v34 = list_pop(vl) 

v35 = list_pop(vl) 

guard_type (v34, int) 

guard_type (v35, int) 

v36 = add (v35, v34) 

list_append (vl, v36) 

v37 = add (v32, 1) 

v38 = load_instruction (v37) 

guard_eq(v38, INSTR_VAR_SET ) 

v39 = list_pop(vl) 

dict_set(v2, "x", v39) 

v40 = add (v37 , 1) 
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Trace optimisation (1) 


Removing constants (from jit_merge_point) 


vl = <stack> 

v2 = <vars> 

v4 = dict_get(v2, "x") 

list_append (vl, v4) 

list_append (vl, 0) 

v9 = list_pop(vl) 

vlO = list_pop(vl) 

guard_type (v9, int) 

guard_type (vlO, int) 

guard_not_less_than (v9, vlO) 

list_append (vl. False) 

vl3 = list_pop(vl) 

guard_false (vl3) 

vl6 = dict_get (v2, "x") 

list_append (vl, vl6) 

list_append (vl, 2) 

v21 = list_pop(vl) 

v22 = list_pop(vl) 

guard_type (v21, int) 

guard_type (v22, int) 

v23 = add (v22, v21) 

list_append(vl, v23) 

v26 = list_pop(vl) 

dict_set(v2, "x", v26) 

v29 = dict_get(v2, "x") 

list_append (vl, v29) 

list_append(vl, 3) 
v34 = list_pop(vl) 
v35 = list_pop(vl) 
guard_type (v34, int) 
guard_type (v35, int) 
v36 = add(v35, v34) 
list_append(vl, v36) 
v39 = list_pop(vl) 
dict_set(v2, "x", v39) 
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Optimisation #2 & #3 


List folded trace 


vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type (v4, int) 
guard_not_less_than (v4, 0) 
vl6 = dict_get(v2, "x") 
guard_type (vl6, int) 
v23 = add(vl6, 2) 
dict_set(v2, "x", v23) 
v29 = dict_get(v2, "x") 
guard_type (v29, int) 
v36 = add (v29, 3) 
dict_set(v2, "x", v36) 
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Optimisation #2 & #3 


List folded trace 

Diet folded trace 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type (v4, int) 
guard_not_less_than (v4, 0) 
vl6 = dict_get(v2, "x") 
guard_type (vl6, int) 
v23 = add(vl6, 2) 
dict_set(v2, "x", v23) 
v29 = dict_get(v2, "x") 
guard_type (v29, int) 
v36 = add (v29, 3) 
dict_set(v2, "x", v36) 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type ( v4 , int ) 
guard_not_less_than (v4, 0) 
v23 = add (v4 , 2) 
guard_type (v23, int) 
v36 = add(v23, 3) 
dict_set(v2, "x", v36) 
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Optimisation #4 & #5 


Type folded trace 


vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type (v4, int) 
guard_not_less_than <v4, 0) 
v23 = add (v4 , 2) 
v36 = add (v23, 3) 
dict_set(v2, "x", v36) 
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Optimisation #4 & #5 


Type folded trace 

Arithmetic folded trace 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type (v4, int) 
guard_not_less_than <v4, 0) 
v23 = add (v4 , 2) 
v36 = add (v23, 3) 
dict_set(v2, "x", v36) 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type ( v4 , int ) 
guard_not_les s_than ( v4 , 0 ) 
v23 = add (v4 , 5) 
dict_set(v2, "x", v23) 
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Optimisation #4 & #5 


Type folded trace 

Arithmetic folded trace 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type (v4, int) 
guard_not_less_than <v4, 0) 
v23 = add (v4 , 2) 
v36 = add (v23, 3) 
dict_set(v2, "x", v36) 

vl = <stack> 
v2 = <vars> 
v4 = dict_get(v2, "x") 
guard_type ( v4 , int ) 
guard_not_les s_than ( v4 , 0 ) 
v23 = add (v4 , 5) 
dict_set(v2, "x", v23) 

Trace optimisation: 

from 72 trace elements to 7. 
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